Image processing apparatus

ABSTRACT

A facsimile image reception portion obtains a facsimile image received through a communication line. An image storage portion stores a facsimile image obtained by the facsimile image reception portion. A destination storage portion stores at least one transfer destination of the facsimile image and a set value for limiting received data by making connection with each other for each of transfer destinations. A character recognition portion obtains character data by performing character recognition from a facsimile image obtained by the facsimile image reception portion. A character recognition operation control portion compares a set value for limiting received data to character data obtained by a character recognition portion to control whether or not character recognition by the character recognition portion is continued. An electronic mail creation portion creates an electronic mail in which character data obtained by the character recognition portion is described.

CROSS-NOTING PARAGRAPH

This non-provisional application claims priority under 35 U.S.C. §119(a)on Patent Application No. 2009-044150 filed in JAPAN on Feb. 26, 2009,the entire contents of which are hereby incorporated herein byreference.

FIELD OF THE INVENTION

The present invention relates to an image processing apparatus, and moreparticularly to an image processing apparatus having a facsimilereceiving function and analyzing a received facsimile image to transferto a specific transfer destination.

BACKGROUND OF THE INVENTION

There is a strong demand for, by using a mobile telephone, checking afacsimile image when going out by transferring a received facsimileimage to a mobile telephone. Therefore, a system has been conventionallydevised for transferring a facsimile image to a specific transferdestination by using an electronic mail from an image processingapparatus provided with a facsimile receiving function.

For example, Japanese Laid-Open Patent Publication No. 2008-252544discloses a method that applies character recognition to an imagereceived by facsimile and transfers the results by describing them in abody of an electronic mail. By this method, it is possible to reduce acapacity of an electronic mail comparing to a method for attachingfacsimile image data. In addition, even with a terminal whose viewerfunction for viewing an image is limited, contents of an image receivedby facsimile can be checked.

In an invention of Japanese Laid-Open Patent Publication No.2008-252544, since character recognition processing is performed for allimages received by facsimile, many computational resources are needed onthe side of an image processing apparatus, thus there is a problem oftaking time to transfer.

SUMMARY OF THE INVENTION

An object of the present invention is to provide an image processingapparatus which performs character recognition on a received facsimileimage and transfers the image to a specific transfer destination bye-mail, wherein the image processing apparatus is capable of shorteningtransfer time of facsimile data by reducing the amount of characterrecognition processing performed at the time of transferring a facsimileimage.

It is another object of the present invention to provide an imageprocessing apparatus connectable to a communication line, comprising: afacsimile image reception portion for obtaining a facsimile image whichis received through the communication line; an image storage portion forstoring the facsimile image which is obtained by the facsimile imagereception portion; a destination storage portion for storing at leastone transfer destination of the facsimile image in association with aset value for limiting received data for each transfer destination; acharacter recognition portion for obtaining character data by characterrecognition of the facsimile image which is obtained by the facsimileimage reception portion; a character recognition operation controlportion for controlling whether or not character recognition by thecharacter recognition portion is continued by comparing the set valuefor limiting received data to character data which is obtained by thecharacter recognition portion; and an electronic mail creation portionfor creating an electronic mail in which character data obtained by thecharacter recognition portion is described in a body of the electronicmail.

It is another object of the present invention to provide the imageprocessing apparatus, wherein the set value for limiting received datais a set value for limiting the number of characters of the characterdata or is a set value for limiting data amount of the character data.

It is another object of the present invention to provide the imageprocessing apparatus, wherein the set value for limiting received datais a set value for setting a maximum number of characters or data amountamong the number of characters or data amount of character data inassociation with a plurality of transfer destinations.

It is another object of the present invention to provide the imageprocessing apparatus, wherein the transfer destinations are electronicmail addresses of a portable computer terminal device.

It is another object of the present invention to provide the imageprocessing apparatus comprising a cover letter storage portion capableof storing at least one template of a facsimile cover letter in order tospecify a region to be read by the character recognition portion.

It is another object of the present invention to provide the imageprocessing apparatus comprising a layout analysis portion having afunction of analyzing a layout structure of the facsimile image based onpredetermined conditions and dividing the facsimile image into regionsdepending on the layout structure, and wherein the character recognitionportion obtains character data by performing the character recognitionfor each of the divided regions.

It is another object of the present invention to provide the imageprocessing apparatus, wherein the character recognition operationcontrol portion has a determination portion for determining whether thenumber of characters describable in the region where the font size isobtained exceeds the set value for limiting received data by obtaining afont size in the divided region.

It is another object of the present invention to provide the imageprocessing apparatus, wherein the character recognition operationcontrol portion determines whether the character recognition iscontinued every time predetermined characteristics are obtained from theresult of character recognition by the character recognition in a casewhere the number of characters describable in the region where the fontsize is obtained in the determination portion exceeds the set value forlimiting received data.

It is another object of the present invention to provide the imageprocessing apparatus, wherein the predetermined characteristics arepredetermined character data.

It is another object of the present invention to provide the imageprocessing apparatus, wherein the predetermined characteristics are ablank region set between character data strings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram for showing an exemplary system configuration towhich an image processing apparatus according to the present inventionis applicable;

FIG. 2 is a configuration schematic diagram of an embodiment of theimage processing apparatus according to the present invention;

FIG. 3 is a diagram for showing an example of a transfer destinationtable that is stored in a destination storage portion;

FIG. 4 is a diagram for showing an example of a facsimile image receivedby the image processing apparatus;

FIG. 5 is a flowchart for explaining exemplary processing of the imageprocessing apparatus according to the present invention;

FIG. 6 is a diagram for showing an example of a display screen on amobile telephone in which a result that character recognition isperformed in a reading region shown in FIG. 4 is received by anelectronic mail;

FIG. 7 is a diagram for showing an example of a display screen on amobile telephone in which a result that character recognition isperformed for the entire facsimile image shown in FIG. 4 as a readingregion for character recognition is received by an electronic mail; and

FIG. 8 is a configuration schematic diagram of another embodiment of theimage processing apparatus according to the present invention.

PREFERRED EMBODIMENTS OF THE INVENTION

In an Image processing apparatus provided with a receiving function of afacsimile image, in order to diminish a computational load byefficiently performing character recognition processing of an imagereceived by facsimile, it is significantly important to lessen objectsfor performing character recognition. In an embodiment according to thepresent invention, in the image processing apparatus, an amount ofimages to which character recognition is performed is lessened inaccordance with data capacity such as the number of data and an amountof data receivable by a receiving terminal such as a mobile terminal asa transmitting destination of a character recognition result of afacsimile image.

Generally, in a mobile terminal, data which exceeds the number ofreceived characters determined by a service provider or an upper limitvalue of data amount can not be received because the data is deleted ata server. Further, a user oneself sometimes sets the number of receivedcharacters to any values so that a receiving fare is not charged. In anembodiment according to the present invention, a receiving limit valuefor each transfer destination is registered in the image processingapparatus in advance so that unnecessary character recognition in whichreceiving is limited at a mobile terminal is not made to be performed.

In addition, in an embodiment according to the present invention, it ismade possible that a cover letter template is registered in the imageprocessing apparatus and character string within a receiving upper limitvalue is extracted from a specific image region so that a user is ableto selectively extract contents that are desired for checking.

Hereinafter, description will be given specifically for embodiments ofthe image processing apparatus according to the present invention withreference to the attached drawings.

FIG. 1 is a diagram for showing an exemplary system configuration towhich the image processing apparatus according to the present inventionis applicable. An image processing apparatus 10 is provided with atleast a receiving function of a facsimile image. In addition, the imageprocessing apparatus 10 may be configured as a multi-functionalperipheral provided with a copy function, a scanner function, a printerfunction, a filing function and the like in addition to a facsimilefunction.

The image processing apparatus 10 is connected to a facsimile terminal11 through a public line 12. In addition, the image processing apparatus10 is connected to mobile terminals 14, 15, 16, and 17 through aninternet line 13. The mobile terminals 14 to 17 are examples of themobile computer terminal of the present invention, which is set as atransfer destination of a facsimile image.

When a facsimile image 18 is transmitted together with a facsimile coverletter to the image processing apparatus 10 from the facsimile terminal11, the image processing apparatus 10 determines a reading region of thereceived facsimile image 18, applies character recognition processing tothe reading region, and transmits the obtained character data electronicmail 19 to specific mobile terminals 14, 15, 16, and 17 by electricmail. Specific functions and operation examples thereof will bedescribed below.

FIG. 2 is a configuration schematic diagram of an embodiment of theimage processing apparatus according to the present invention. In thediagram, 10 denotes the image processing apparatus, 101 denotes afacsimile image reception portion for obtaining a received facsimileimage, 102 denotes an image storage portion for storing a facsimileimage, 103 denotes a cover letter storage portion for storing a templateof a facsimile cover letter (cover letter template), 104 denotes adestination storage portion for storing a destination to be a transferdestination of a facsimile image, 105 denotes an input portion forenabling an operation input by a user, 106 denotes a display portion fordisplaying various pieces of information and data, 107 denotes acharacter recognition operation control portion for controllingcharacter recognition processing for a facsimile image, 108 denotes acharacter recognition portion for performing the character recognitionprocessing for a facsimile image, 109 denotes an electronic mailcreation portion for creating an electronic mail in which character dataobtained by the character recognition processing is described, 110denotes an electronic mail transmission portion for transmitting acreated electronic mail, 111 denotes a layout analysis portion foranalyzing a layout structure of a facsimile image and dividing thefacsimile image into regions in accordance with the analyzed layoutstructure. The input portion 105 above is comprised of a touch panelprovided in the display portion 106, for example. In addition, a numerickeypad, a pointer, a remote controller and the like may be applicable asthe input portion 105.

The user is able to store the cover letter template in the cover letterstorage portion 103 by performing operation input to the input portion105 while checking a display on the display portion 106. The coverletter storage portion 103, in a not shown template table, stores aregion for reading an image from the cover letter and performingcharacter recognition (reading region) and an image of the cover lettertemplate by making connection with each other. The region to be relatedto the cover letter template is determined in advance in accordance witheach cover letter template, and for example, a region for performingcharacter recognition is determined appropriately in accordance with aformat of the cover letter or the like so that the user is able toselectively extract contents that are desired for checking by anelectronic mail from a facsimile image.

In addition, the user is able to register an electronic mail address ofthe transfer destination of the facsimile image to the destinationstorage portion 104 by performing operation input to the input portion105 while checking the display on the display portion 106.

The destination storage portion 104 stores a destination to be thetransfer destination of the facsimile image as a transfer destinationtable. FIG. 3 is a diagram for showing an example of a transferdestination table that is stored in the destination storage portion 104.In FIG. 3, a transfer destination ID 21 is a unique number that isallotted for each transfer destination. A transfer destination address22 represents an electronic mail address of the transfer destination. Areceiving limit 23 represents whether or not an upper limit value ofreceived data is set in a receiving terminal of the transfer destination(mobile terminals 14 to 17 in the example of FIG. 1). That is, thereceiving limit 23 shows a flag representing whether an upper limit ofthe number of characters 24 as receiving limit of the number ofcharacters is set. In this example, all transfer destinations registeredin the transfer destination table are objects of transfer of a facsimileimage. However, specification of the transfer destination is not limitedto this method, and for example, it may be configured such that atransfer switch flag is provided for each transfer destination to beable to transfer to a part of transfer destinations out of theregistered transfer destinations. In transferring the facsimile image,actually, character recognition is performed for each divided regionobtained by the layout analysis of the facsimile image, and the obtainedcharacter data is transferred to the transfer destination in a form ofan electronic mail.

Next, description will be given for an operation of the image processingapparatus 10. FIG. 5 is a flowchart for explaining an exemplaryprocessing of the image processing apparatus according to the presentinvention. It is assumed here that the image processing apparatus 10 hasreceived a facsimile image 30 shown in FIG. 4 by facsimile.

First, the image processing apparatus 10 obtains a facsimile imagereceived through a communication line in the facsimile image receptionportion 101 to cause the image storage portion 102 to store the receivedimage (processing S1). Subsequently, the image processing apparatus 10refers to the cover letter storage portion 103 and performs imagematching between the obtained facsimile image 30 and the cover lettertemplate (processing S2). A method of image matching is not particularlylimited and various methods known conventionally are usable. In thisexample, the image matching is realized by a method for extractingcharacteristic shapes such as a size, a configuration, and arrangementof a block constituting a character part that is present in the entireor a part of the facsimile image as an object, arrangement and thicknessof lines, ruled lines and the like that are present in the entire or apart of the image, each type of images, etc., and for collating theextracted shapes with the cover letter template.

When a cover letter template matching the facsimile image obtained as aresult of the image matching by the processing S2, is stored in thecover letter storage portion 103 (processing S3-Yes) , a region relatedto the cover letter template is a reading region for characterrecognition (processing S4). In this example, a region related to thecover letter template matching the facsimile image 30 of FIG. 4 is aregion 31.

On the other hand, when there are no cover letter templates matching thereceived facsimile image in the processing S3, the entire facsimileimage is a reading region for character recognition (processing S9).

When character recognition is performed for the reading region, thelayout structure of the reading region is first analyzed (processingS5). In performing character recognition, algorithm is known forenhancing recognition accuracy by using a word dictionary and a syntaxdictionary. Therefore, in the processing S5, the layout structure ofimages is analyzed for the reading region determined by the processingS4 or the processing S9.

In this example, the layout analysis portion 111 extracts arrangement,thickness and a type of lines, ruled lines and the like constituting acharacter part that is present in a reading region of the facsimileimage 30 to perform processing for dividing regions into sections. Forexample, each cell of a table described in a reading region isseparately divided as sections.

In the following character recognition processing, character recognitionprocessing (processing S6) is then executed for each divided region. Thevalue of the upper limit of the number of characters 24 of all transferdestination IDs of the transfer destination table is then compared tothe number of characters of character data obtained by characterrecognition processing every time character recognition processingfinishes in a divided region, and the number of characters of characterdata that is character-recognized is determined whether or not reachingthe upper limit of the number of characters 24 of all transferdestination IDs (processing S7). When character data that ischaracter-recognized reaches the upper limit of the number of characters24 of all transfer destination IDs, character recognition processing isfinished, an electronic mail containing character data that ischaracter-recognized is created, and the electronic mail thereof istransmitted to transfer destination addresses of all transferdestination IDs (processing S8).

On the other hand, when character data that is character-recognized doesnot reach an upper limit of the number of characters of all transferdestination IDs, character recognition is executed in processing S6 forthe following divided region. That is, when a plurality of the transferdestination IDs are stored in the transfer table, character recognitionprocessing is repeated until reaching a maximum value of the upper limitof the number of characters 24.

An effect of an embodiment according to the present invention is that anelectronic mail can be created by performing character recognitionreading only a minimal amount of a part of characters contained in afacsimile image, and it is possible to make character recognitionprocessing efficiently.

FIG. 6 is a diagram for showing an example of a display screen on amobile telephone in which a result that character recognition isperformed in a region 31 shown in FIG. 4 is received by an electronicmail. In this example, it is assumed that the region 31 shown in FIG. 4is a reading region and a result that character recognition is performedto the reading region thereof is transferred by an electronic mail.Transfer destination ID 21 at this time is “4” shown in FIG. 3, and ascreen 41 shown in FIG. 6 shows a screen of a mobile telephone in whichthe transfer destination ID 21 is set to “4”.

As shown in FIG. 3, the upper limit of the number of characters 24 ofthe transfer destinations in which “4” is set as transfer destination ID21 is “150” as a maximum value in the transfer destination ID 21 set tothe transfer destination table. Therefore, when an electronic mail iscreated by the image processing apparatus, an electronic mail is createdto be transmitted at the time the number of characters obtained bycharacter recognition processing for each divided region reaches 150characters. Ina screen 41 of a mobile telephone whose transferdestination ID is “4”, an electronic mail is displayed in accordancewith “150” as an upper limit of the number of characters as shown inFIG. 6.

On the other hand, when there are no cover letter templates matching afacsimile image, the entire facsimile image is a reading region forcharacter recognition processing, while character recognition processingis performed at this time for each divided region from the beginning ofthe facsimile image and the obtained character data is transmitted as abody of an electronic mail.

FIG. 7 is a diagram for showing an example of a display screen on amobile telephone in which a result that the entire facsimile image shownin FIG. 4 is character-recognized as a reading region for characterrecognition is received by an electronic mail. Transfer destination ID21 at this time is “4” shown in FIG. 3 and the screen 41 shown in FIG. 7shows a screen of a mobile telephone whose transfer destination ID 21 isset to “4”.

Similarly, also in this case, the upper limit of the number ofcharacters 24 of a transfer destination whose transfer destination ID 21is set to “4” is “150” as a maximum value in the transfer destination ID21 set to the transfer destination table. Therefore, when an electronicmail is created by the image processing apparatus, an electronic mail iscreated to be transmitted at the time the number of characters ofcharacter data obtained by character recognition processing for eachdivided region reaches 150 characters. In a screen 41 of a mobiletelephone whose transfer destination ID is set to “4”, an electronicmail is displayed in accordance with “150” as an upper limit of thenumber of characters as shown in FIG. 7. Here, an electronic mail isdisplayed in the same number of “150” characters as that of the displayscreen of FIG. 6, which case is, however, different from the case ofFIG. 6, and character recognition processing is performed from thebeginning of the facsimile image 30.

In addition, in the above example of FIG. 3, in the transfer destinationtable that is stored in the destination storage portion 104, the upperlimit of the number of characters 24 that is a value of the receivinglimit of the number of characters has been set, however, in place of theupper limit of the number of characters 24, either one of the number ofcharacters or data amount of character data maybe settable as an upperlimit value. The number of bytes of the character data is usable as avalue showing the data amount.

In this case, processing for converting character data that ischaracter-recognized to bytes is added to the processing S7 of FIG. 5.For destinations in which the number of bytes is set as an upper limitvalue in the transfer destination table, the number of converted bytesis compared to the number of bytes of an upper limit set to the transferdestination table, and when the number of converted bytes reaches anupper limit of the number of bytes, the character data that ischaracter-recognized is transmitted as an electronic mail.

FIG. 8 is a configuration schematic diagram of another embodiment of theimage processing apparatus according to the present Invention. In FIG.8, a character recognition operation control portion 107 has adetermination portion 112. The determination portion 112 obtains a fontsize in a region divided by the layout analysis portion 111 to determinewhether or not the number of characters describable in the dividedregion exceeds a set value for limiting received data. Otherconfigurations are the same as those of FIG. 2 and repeated explanationsare thus omitted.

In analysis processing of the layout structure in the above processingS4 of FIG. 5, arrangement, thickness and a type of lines, ruled linesand the like constituting a character part that is present in thereading region of the facsimile image 30 are extracted to performprocessing for dividing regions as sections. For example, each cell of atable described in the reading region has been separately divided assections, and character recognition processing is executed for each cellthereof.

The number of characters embedded in one of divided regions sometimessubstantially exceeds a set upper limit of the number of characters.Therefore, in the other embodiments according to the present invention,a step for obtaining a font size of a divided region is added to theprocessing S5 of FIG. 5. At this step, a method for obtaining a fontsize which is most frequently used in a divided region by distinguishinga character pitch by image analysis, a method for registering a fontsize in a template in advance and the like are applicable, however,various methods are applicable, not limited particularly to thesemethods.

As a result of comparing the obtained font size to a size of a dividedregion, when it is determined that the number of characters describablein a divided region exceeds a maximum value of an upper limit value ofthe number of characters described in the transfer table,creation/transmitting processing of an electronic mail (S8) areconducted appropriately during performing character recognition for eachdivided region. In processing S8, when predetermined character data orpattern is detected in character recognition processing, characterrecognition results so far are transmitted as electronic mails. As thepredetermined character data in this case, for example, a period “.”, aninterrogation mark “?”, an exclamation mark “!” and the like areapplicable. In addition, as a predetermined pattern, a blank region setbetween character data strings is applicable. That is, characters andpatterns representing a grammatical break in a sentence are detected,and it is then possible to transmit the character recognition results sofar by an electronic mail. By this embodiment, even when the number ofcharacters describable in a divided region such as a cell in a table islarger than an upper limit value of the predetermined number ofcharacters, it is possible to restrain processing for recognizingunnecessary character in transmitting an electronic mail.

Note that, the present invention is not limited to the embodimentsdescribed above, and various changes are possible in the scopedesignated in claims. That is, the embodiments obtained by combiningtechnical means that are changed appropriately in the scope designatedin claims are also included in a technical scope of the presentinvention.

According to the present invention, in the image processing apparatusprovided with a function of transferring facsimile data received byfacsimile to a specific transfer destination by an electronic mail, itis possible to provide an image processing apparatus which reduces theamount of character recognition processing that is performed at the timeof transferring facsimile data and is able to shorten transfer time offacsimile data.

1. An image processing apparatus connectable to a communication line,comprising: a facsimile image reception portion for obtaining afacsimile image which is received through the communication line; animage storage portion for storing the facsimile image which is obtainedby the facsimile image reception portion; a destination storage portionfor storing at least one transfer destination of the facsimile image inassociation with a set value for limiting received data for eachtransfer destination; a character recognition portion for obtainingcharacter data by character recognition of the facsimile image which isobtained by the facsimile image reception portion; a characterrecognition operation control portion for controlling whether or notcharacter recognition by the character recognition portion is continuedby comparing the set value for limiting received data to character datawhich is obtained by the character recognition portion; and anelectronic mail creation portion for creating an electronic mail inwhich character data obtained by the character recognition portion isdescribed in a body of the electronic mail.
 2. The image processingapparatus as defined in claim 1, wherein the set value for limitingreceived data is a set value for limiting the number of characters ofthe character data or is a set value for limiting data amount of thecharacter data.
 3. The image processing apparatus as defined in claim 2,wherein the set value for limiting received data is a set value forsetting a maximum number of characters or data amount among the numberof characters or data amount of character data in association with aplurality of transfer destinations.
 4. The image processing apparatus asdefined in claim 1, wherein the transfer destinations are electronicmail addresses of a portable computer terminal device.
 5. The imageprocessing apparatus as defined in claim 1, comprising a cover letterstorage portion capable of storing at least one template of a facsimilecover letter in order to specify a region to be read by the characterrecognition portion.
 6. The image processing apparatus a defined inclaim 1, comprising a layout analysis portion having a function ofanalyzing a layout structure of the facsimile image based onpredetermined conditions and dividing the facsimile image into regionsdepending on the layout structure, and wherein the character recognitionportion obtains character data by performing the character recognitionfor each of the divided regions.
 7. The image processing apparatus asdefined in claim 6, wherein the character recognition operation controlportion has a determination portion for determining whether the numberof characters describable in the region where the font size is obtainedexceeds the set value for limiting received data by obtaining a fontsize in the divided region.
 8. The image processing apparatus as definedin claim 7, wherein the character recognition operation control portiondetermines whether the character recognition is continued every timepredetermined characteristics are obtained from the result of characterrecognition by the character recognition in a case where the number ofcharacters describable in the region where the font size is obtained mthe determination portion exceeds the set value for limiting receiveddata.
 9. The image processing apparatus as defined in claim 8, whereinthe predetermined characteristics are predetermined character data. 10.The image processing apparatus as defined in claim 8, wherein thepredetermined characteristics are a blank region set between characterdata strings.
 11. The image processing apparatus as defined in claim 2comprising a cover letter storage portion capable of storing at leastone template of a facsimile cover letter in order to specify a region tobe read by the character recognition portion.
 12. The image processingapparatus as defined in claim 3, comprising a cover letter storageportion capable of storing at least one template of a facsimile coverletter in order to specify a region to be read by the characterrecognition portion.
 13. The image processing apparatus as defined inclaim 4, comprising a cover letter storage portion capable of storing atleast one template of a facsimile cover letter in order to specify aregion to be read by the character recognition portion.
 14. The imageprocessing apparatus a defined in claim 2, comprising a layout analysisportion having a function of analyzing a layout structure of thefacsimile image based on predetermined conditions and dividing thefacsimile image into regions depending on the layout structure, andwherein the character recognition portion obtains character data byperforming the character recognition for each of the divided regions.15. The image processing apparatus a defined in claim 3, comprising alayout analysis portion having a function of analyzing a layoutstructure of the facsimile image based on predetermined conditions anddividing the facsimile image into regions depending on the layoutstructure, and wherein the character recognition portion obtainscharacter data by performing the character recognition for each of thedivided regions.
 16. The image processing apparatus a defined in claim4, comprising a layout analysis portion having a function of analyzing alayout structure of the facsimile image based on predeterminedconditions and dividing the facsimile image into regions depending onthe layout structure, and wherein the character recognition portionobtains character data by performing the character recognition for eachof the divided regions.